Electronic device for displaying screen and method of controlling same

ABSTRACT

Disclosed is a method of controlling an electronic device and an electronic device. The method may include: acquiring motion information of an electronic device; performing an inertial force correction for removing a part by an inertial force from the acquired motion information; and displaying a screen corresponding to the inertial force-corrected motion information.

CROSS-REFERENCE TO RELATED APPLICATION(S) AND CLAIM OF PRIORITY

The present application is related to and claims benefit under 35 U.S.C.§ 119(a) to Korean Application Serial No. 10-2015-0070454, which wasfiled in the Korean Intellectual Property Office on May 20, 2015, theentire content of which is hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to an electronic device for displaying ascreen and a method of controlling the same.

BACKGROUND

Electronic devices may be wearable by a user and may be known aswearable devices. The wearable devices may include a head mountedelectronic device such as a Head Mounted Display (HMD).

The HMD device may be worn on a user's body part (for example, theuser's head) and provide a virtual reality environment to the user. Thevirtual reality environment may be provided, for example, by displayinga screen and/or various user interfaces which can implement the virtualreality.

An HMD may sense an acceleration or an angular acceleration and displaya screen in accordance with the sensed acceleration or angleacceleration. Accordingly, the HMD may change and display the screen inaccordance with a user's motion, and the user may experience actualreality by viewing the changed screen. Meanwhile, the user may board atransportation means while wearing the HMD. In this case, thetransportation means may accelerate. For example, when the user takes asubway, the subway may accelerate at a departure time point or anarrival time point. The acceleration of the transportation means mayresult in an inertial force applied to the HMD included in an inertialframe of the transportation means. The HMD may sense the inertial forceand change the screen in accordance with the inertial force.Accordingly, the HMD may display a screen which the user does not want.

SUMMARY

To address the above-discussed deficiencies, it is an object to provide,for use in an electronic device for correcting an inertial force and amethod of controlling the same.

In accordance with an aspect of the present disclosure, a method ofcontrolling an electronic device is provided. The method includes: anoperation of acquiring motion information of an electronic device; anoperation of performing an inertial force correction for removing a partby an inertial force from the acquired motion information; and anoperation of displaying a screen corresponding to the inertialforce-corrected motion information.

In accordance with another aspect of the present disclosure, anelectronic device is provided. The electronic device includes: adisplay; a processor electrically connected to the display; a memoryelectrically connected to the processor; and a motion informationsensing module that is electrically connected to the processor andacquires motion information of the electronic device, wherein the memorystores instructions to instruct the processor to perform an inertialforce correction for removing a part by an inertial force from theacquired motion information and to control the display to display ascreen corresponding to the inertial force-corrected motion informationwhen the instructions are executed.

Embodiments of the present disclosure may provide an electronic devicefor correcting an inertial force and a method of controlling the same.Accordingly, when a user wears the electronic devices and boards atransportation means that accelerates, the electronic device may displaya screen corresponding to a motion intended by the user. Therefore, itis possible to solve the problem in which the user views an unintendedscreen due to the inertial force.

Before undertaking the DETAILED DESCRIPTION below, it may beadvantageous to set forth definitions of certain words and phrases usedthroughout this patent document: the terms “include” and “comprise,” aswell as derivatives thereof, mean inclusion without limitation; the term“or,” is inclusive, meaning and/or; the phrases “associated with” and“associated therewith,” as well as derivatives thereof, may mean toinclude, be included within, interconnect with, contain, be containedwithin, connect to or with, couple to or with, be communicable with,cooperate with, interleave, juxtapose, be proximate to, be bound to orwith, have, have a property of, or the like; and the term “controller”means any device, system or part thereof that controls at least oneoperation, such a device may be implemented in hardware, firmware orsoftware, or some combination of at least two of the same. It should benoted that the functionality associated with any particular controllermay be centralized or distributed, whether locally or remotely.Definitions for certain words and phrases are provided throughout thispatent document, those of ordinary skill in the art should understandthat in many, if not most instances, such definitions apply to prior, aswell as future uses of such defined words and phrases.

BRIEF DESCRIPTION OF THE DRAWINGS

For a more complete understanding of the present disclosure and itsadvantages, reference is now made to the following description taken inconjunction with the accompanying drawings, in which like referencenumerals represent like parts:

FIG. 1 illustrates a block diagram of an electronic device and a networkaccording to various embodiments of the present disclosure;

FIG. 2 illustrates a block diagram of an electronic device according tovarious embodiments;

FIG. 3 illustrates a block diagram of a program module according tovarious embodiments;

FIG. 4A illustrates a perspective view illustrating an electronic deviceaccording to an embodiment of the present disclosure;

FIG. 4B illustrates displaying of the electronic device according to anembodiment;

FIG. 4C illustrates a conceptual diagram of a screen viewed by the user;

FIG. 5A illustrates a perspective view illustrating a user wearing anHMT device;

FIGS. 5B to 5E illustrate conceptual diagrams illustrating screenswitching of the electronic device according to various embodiments ofthe present disclosure;

FIGS. 6A to 6C illustrate conceptual diagrams illustrating an operationof the electronic device according to various embodiments of the presentdisclosure;

FIG. 7 illustrates a flowchart illustrating a control method of theelectronic device according to various embodiments of the presentdisclosure;

FIGS. 8A to 8C illustrate conceptual diagrams illustrating an operationof the electronic device according to various embodiments of the presentdisclosure;

FIG. 9 illustrates a flowchart illustrating an inertial force correctionmethod according to various embodiments of the present disclosure;

FIG. 10 illustrates a conceptual diagram illustrating the electronicdevice and another electronic device according to various embodiments ofthe present disclosure;

FIGS. 11A and 11B illustrate flowcharts illustrating a control method ofthe electronic device according to various embodiments of the presentdisclosure;

FIG. 12 illustrates a flowchart illustrating a control method of theelectronic device according to various embodiments of the presentdisclosure;

FIGS. 13A and 13B are conceptual diagrams illustrating an inertialcorrection using a biometric signal according to various embodiments ofthe present disclosure;

FIG. 14 illustrates a flowchart illustrating a control method of theelectronic device according to various embodiments of the presentdisclosure;

FIG. 15 illustrates a flowchart illustrating a control method of theelectronic device according to various embodiments of the presentdisclosure;

FIGS. 16A to 16C illustrate conceptual diagrams illustrating a change inan orientation of the electronic device 101 according to variousembodiments of the present disclosure;

FIG. 17 illustrates a flowchart illustrating a control method of theelectronic device according to various embodiments of the presentdisclosure;

FIG. 18 illustrates a flowchart illustrating a control method of theelectronic device according to various embodiments of the presentdisclosure;

FIGS. 19A and 19B illustrate conceptual diagrams illustrating aninertial force correction of the electronic device according to variousembodiments of the present disclosure;

FIG. 20 illustrates a flowchart illustrating a control method of theelectronic device according to various embodiments of the presentdisclosure;

FIGS. 21A and 21B illustrate conceptual diagrams illustrating anelectronic device according to various embodiments of the presentdisclosure;

FIG. 22 illustrates a flowchart illustrating a control method of theelectronic device according to various embodiments of the presentdisclosure; and

FIG. 23 illustrates a conceptual diagram illustrating an electronicdevice according to various embodiments of the present disclosure.

DETAILED DESCRIPTION

FIGS. 1 through 23, discussed below, and the embodiments used todescribe the principles of the present disclosure in this patentdocument are by way of illustration and should not be construed in anyway to limit the scope of the disclosure. Those skilled in the art willunderstand that the principles of the present disclosure may beimplemented in any suitably arranged electronic device. Hereinafter,embodiments of the present disclosure will be described with referenceto the accompanying drawings. However, it should be understood thatthere is no intent to limit the present disclosure to the particularforms disclosed herein; rather, the present disclosure should beconstrued to cover various modifications, equivalents, and/oralternatives of embodiments of the present disclosure. In describing thedrawings, similar reference numerals may be used to designate similarconstituent elements.

As used herein, the expression “have”, “may have”, “include”, or “mayinclude” refers to the existence of a corresponding feature (e.g.,numeral, function, operation, or constituent element such as component),and does not exclude one or more additional features.

In the present disclosure, the expression “A or B”, “at least one of Aor/and B”, or “one or more of A or/and B” may include all possiblecombinations of the items listed. For example, the expression “A or B”,“at least one of A and B”, or “at least one of A or B” refers to all of(1) including at least one A, (2) including at least one B, or (3)including all of at least one A and at least one B.

The expression “a first”, “a second”, “the first”, or “the second” usedin various embodiments of the present disclosure may modify variouscomponents regardless of the order and/or the importance but does notlimit the corresponding components. For example, a first user device anda second user device indicate different user devices although both ofthem are user devices. For example, a first element may be termed asecond element, and similarly, a second element may be termed a firstelement without departing from the scope of the present disclosure.

It should be understood that when an element (e.g., first element) isreferred to as being (operatively or communicatively) “connected,” or“coupled,” to another element (e.g., second element), it may be directlyconnected or coupled directly to the other element or any other element(e.g., third element) may be interposed between them. In contrast, itmay be understood that when an element (e.g., first element) is referredto as being “directly connected,” or “directly coupled” to anotherelement (second element), there are no elements (e.g., third element)interposed between them.

The expression “configured to” used in the present disclosure may beexchanged with, for example, “suitable for”, “having the capacity to”,“designed to”, “adapted to”, “made to”, or “capable of” according to thesituation. The term “configured to” may not necessarily imply“specifically designed to” in hardware. Alternatively, in somesituations, the expression “device configured to” may mean that thedevice, together with other devices or components, “is able to”. Forexample, the phrase “processor adapted (or configured) to perform A, B,and C” may mean a dedicated processor (e.g. embedded processor) forperforming the corresponding operations or a generic-purpose processor(e.g., central processing unit (CPU) or application processor (AP)) thatcan perform the corresponding operations by executing one or moresoftware programs stored in a memory device.

The terms used herein are merely for the purpose of describingparticular embodiments and are not intended to limit the scope of otherembodiments. A singular expression may include a plural expressionunless they are definitely different in a context. Unless definedotherwise, all terms used herein, including technical and scientificterms, have the same meaning as those commonly understood by a personskilled in the art to which the present disclosure pertains. Such termsas those defined in a generally used dictionary may be interpreted tohave the meanings equal to the contextual meanings in the relevant fieldof art, and are not to be interpreted to have ideal or excessivelyformal meanings unless clearly defined in the present disclosure. Insome cases, even the term defined in the present disclosure should notbe interpreted to exclude embodiments of the present disclosure.

An electronic device according to embodiments of the present disclosuremay include at least one of, for example, a smart phone, a tabletpersonal computer (PC), a mobile phone, a video phone, an electronicbook reader (e-book reader), a desktop PC, a laptop PC, a netbookcomputer, a workstation, a server, a personal digital assistant (PDA), aportable multimedia player (PMP), a MPEG-1 audio layer-3 (MP3) player, amobile medical device, a camera, or a wearable device. According toembodiments, the wearable device may include at least one of anaccessory type (e.g., a watch, a ring, a bracelet, an anklet, anecklace, a glasses, a contact lens, or a head-mounted device (HMD)), afabric or clothing integrated type (e.g., an electronic clothing), abody-mounted type (e.g., a skin pad, or tattoo), or a bio-implantabletype (e.g., an implantable circuit).

According to some embodiments, the electronic device may be a homeappliance. The home appliance may include at least one of, for example,a television, a digital video disc (DVD) player, an audio, arefrigerator, an air conditioner, a vacuum cleaner, an oven, a microwaveoven, a washing machine, an air cleaner, a set-top box, a homeautomation control panel, a security control panel, a TV box (e.g.,Samsung HomeSync®, Apple TV®, or Google TV®, a game console (e.g., Xbox®and PlayStation®), an electronic dictionary, an electronic key, acamcorder, or an electronic photo frame.

According to another embodiment, the electronic device may include atleast one of various medical devices (e.g., various portable medicalmeasuring devices (a blood glucose monitoring device, a heart ratemonitoring device, a blood pressure measuring device, a body temperaturemeasuring device, etc.), a magnetic resonance angiography (MRA), amagnetic resonance imaging (MRI), a computed tomography (CT) machine, oran ultrasonic machine), a navigation device, a global positioning system(GPS) receiver, an event data recorder (EDR), a flight data recorder(FDR), a vehicle infotainment devices, an electronic devices for a ship(e.g., a navigation device for a ship, and a gyro-compass), avionics,security devices, an automotive head unit, a robot for home or industry,an automatic teller's machine (ATM) in banks, point of sales (POS) in ashop, or internet device of things (e.g., a light bulb, various sensors,electric or gas meter, a sprinkler device, a fire alarm, a thermostat, astreetlamp, a toaster, a sporting goods, a hot water tank, a heater, aboiler, etc.).

According to some embodiments, the electronic device may include atleast one of a part of furniture or a building/structure, an electronicboard, an electronic signature receiving device, a projector, andvarious kinds of measuring instruments (e.g., a water meter, an electricmeter, a gas meter, and a radio wave meter). In embodiments, theelectronic device may be a combination of one or more of theaforementioned various devices. The electronic device according to someembodiments of the present disclosure may be a flexible device. Further,the electronic device according to an embodiment of the presentdisclosure is not limited to the aforementioned devices, and may includea new electronic device according to the development of technology.

Hereinafter, electronic devices, according to various embodiments of thepresent disclosure, will be described with reference to the accompanyingdrawings. As used herein, the term “user” may indicate a person who usesan electronic device or a device (e.g., an artificial intelligenceelectronic device) that uses an electronic device.

An electronic device 101 within a network environment 100, according tovarious embodiments, will be described with reference to FIG. 1. Theelectronic device 101 may include a bus 110, a processor 120, a memory130, an input/output interface 150, a display 160, and a communicationinterface 170. In some embodiments, the electronic device 101 may omitat least one of the above elements or may further include otherelements.

The bus 110 may include, for example, a circuit which interconnects thecomponents 110 to 170 and delivers communication (for example, a controlmessage and/or data).

The processor 120 may include one or more of a central processing unit(CPU), an application processor (AP), and/or a communication processor(CP). For example, the processor 120 may carry out operations or dataprocessing related to control and/or communication of at least one othercomponent of the electronic device 101.

The memory 130 may include a volatile memory and/or a non-volatilememory. The memory 130 may store, for example, instructions or datarelevant to at least one other element of the electronic device 101.According to an embodiment, the memory 130 may store software and/or aprogram 140. The program 140 may include a kernel 141, middleware 143,an application programming interface (API) 145, and/or an applicationprogram (or “application”) 147. At least some of the kernel 141, themiddleware 143, and the API 145 may be referred to as an operatingsystem (OS).

The kernel 141 may control or manage, for example, system resources (forexample, the bus 110, the processor 120, and the memory 130) which areused to execute an operation or a function implemented in the otherprograms (for example, the middleware 143, the API 145, and theapplication programs 147). Furthermore, the kernel 141 may provide aninterface through which the middleware 143, the API 145, or theapplication programs 147 may access the individual elements of theelectronic device 101 to control or manage the system resources.

The middleware 143 may function as, for example, an intermediary forallowing the API 145 or the application programs 147 to communicate withthe kernel 141 to exchange data.

The middleware 143 may process one or more task requests, which arereceived from the application programs 147, according to prioritiesthereof. For example, the middleware 143 may assign a priority for usingthe system resources (for example, the bus 110, the processor 120, thememory 130, or the like) of the electronic device 101 to at least one ofthe application programs 147. For example, the middleware 143 mayperform scheduling or load balancing on the one or more task requests byprocessing the one or more task requests according to the prioritiesassigned thereto.

The API 145 is an interface through which the applications 147 controlfunctions provided from the kernel 141 or the middleware 143, and mayinclude, for example, at least one interface or function (for example,instruction) for file control, window control, image processing, or textcontrol.

The input/output interface 150 may function as, for example, aninterface that may transfer a command or data input from a user oranother external device to the other element(s) of the electronic device101. Furthermore, the input/output interface 150 may output instructionsor data received from the other element(s) of the electronic device 101to the user or the other external device.

The display 160 may include, for example, a liquid crystal display(LCD), a light-emitting diode (LED) display, an organic light-emittingdiode (OLED) display, a microelectromechanical systems (MEMS) display,and an electronic paper display. The display 160 may display, forexample, various types of contents (for example, text, images, videos,icons, or symbols) to the user. The display 160 may include a touchscreen and receive, for example, a touch, gesture, proximity, orhovering input using an electronic pen or the user's body part.

The communication interface 170 may set, for example, communicationbetween the electronic device 101 and an external device (for example, afirst external electronic device 102, a second external electronicdevice 104, or a server 106). For example, the communication interface170 may be connected to a network 162 through wireless or wiredcommunication to communicate with the external device (for example, thesecond external electronic device 104 or the server 106).

The wireless communication may use, for example, at least one of longterm evolution (LTE), LTE-Advance (LTE-A), code division multiple access(CDMA), wideband CDMA (WCDMA), universal mobile telecommunicationssystem (UMTS), wireless broadband (WiBro), global system for mobilecommunications (GSM) and the like, for example, as a cellularcommunication protocol. In addition, the wireless communication mayinclude, for example, short range communication 164. The short rangecommunication 164 may include at least one of, for example, Wi-Fi,Bluetooth®, near field communication (NFC), and global navigationsatellite system (GNSS). The GNSS may include at least one of, forexample, a global positioning system (GPS), a Russian global navigationsatellite system (GLONASS), a BeiDou navigation satellite system(hereinafter, referred to as “BeiDou”), and a European globalsatellite-based navigation system (hereinafter, referred to as GALILEO).Hereinafter, in the present disclosure, the term “GPS” may beinterchangeably used with the term “GNSS”. The wired communication mayinclude at least one of, for example, a universal serial bus (USB), ahigh definition multimedia interface (HDMI), recommended standard 232(RS-232), and a plain old telephone service (POTS). The network 162 mayinclude at least one of a communication network such as a computernetwork (for example, a LAN or a WAN), the Internet, and a telephonenetwork.

Each of the first and second external electronic devices 102 and 104 maybe of a type identical to or different from that of the electronicdevice 101. According to an embodiment, the server 106 may include agroup of one or more servers. According to embodiments, all or some ofthe operations performed in the electronic device 101 may be performedin another electronic device or a plurality of electronic devices (forexample, the electronic devices 102 and 104 or the server 106).According to an embodiment, when the electronic device 101 has toperform a function or service automatically or in response to a request,the electronic device 101 may request another device (for example, theelectronic device 102 or 104, or the server) to perform at least somefunctions relating thereto, instead of autonomously or additionallyperforming the function or service. Another electronic device (forexample, the electronic device 102 or 104 or the server 106) may executethe requested functions or the additional functions, and may deliver aresult of the execution to the electronic device 101. The electronicdevice 101 may process the received result as it is or additionallyprocess the result and provide the requested functions or services. Toachieve this, for example, cloud computing, distributed computing, orclient-server computing technology may be used.

The electronic device 101 may include a motion information sensingmodule 190 that is electrically connected to the processor 120 andacquires motion information of the electronic device 120. The motioninformation sensing module 190 may include at least one of a linearacceleration sensor, a gyro sensor, and a geomagnetic field sensor,which can sense linear accelerations, rotation angle accelerations, ororientation information of the electronic device. The electronic device101 may acquire motion information of the electronic device 101 based onoutput values from the sensors. For example, the electronic device 101may acquire a linear acceleration of the electronic device 101 based onthe output value from the linear acceleration sensor. The electronicdevice 101 may acquire a rotation angle acceleration of the electronicdevice 101 based on the output value from the gyro sensor. Theelectronic device 101 may acquire a motion in orientation information onthe electronic device 101 based on the output value from each of thegyro sensor and the geomagnetic sensor.

According to embodiments of the present disclosure, the processor 120may be electrically connected to the display 160. Further, the processor120 may be electrically connected to the memory 130. The memory 130 maystore instructions to instruct the processor 120 to perform an inertialforce correction to remove an inertial force component from the acquiredmotion information and to display a screen corresponding to the inertialforce-corrected motion information.

According to embodiments of the present disclosure, the memory 130 mayfurther store instructions to instruct the processor 120 to acquire theinertial force component when the instructions are executed.

According to embodiments of the present disclosure, the communicationmodule 170 may receive the inertial force component from anotherelectronic device which is physically separated from the electronicdevice and senses the inertial force component.

According to embodiments of the present disclosure, the memory 130 mayfurther store instructions to instruct the processor 120 to generate acorrected vector by adding an inverse vector of an inertial accelerationcorresponding to the inertial force component and an accelerationcorresponding to the motion information and to control the display 160to display a screen corresponding to the generated corrected vector whenthe instructions are executed.

According to various embodiments of the present disclosure, the memory130 may further store instructions to instruct the processor 120 toacquire a biometric signal from at least one user's body part whichgenerates the biometric signal when the user moves the electronic deviceand to remove the inertial force component which corresponds to motioninformation acquired while the biometric signal is not acquired when theinstructions are executed. The electronic device 101 may further includea sensor that may acquire a biometric signal and the processor 120 mayacquire a biometric signal from a biometric signal sensor.

According to various embodiments of the present disclosure, the memory130 may further store instructions to instruct the processor 120 todetermine whether the motion information is included in a preset rangeand to remove the inertial force component which corresponds to motioninformation which is outside the preset range when the instructions areexecuted.

According to various embodiments of the present disclosure, the memory130 may further store instructions to instruct the processor 120 toacquire orientation information of the electronic device 101 and toremove the inertial force component which corresponds to motioninformation acquired while orientation information is not changed whenthe instructions are executed.

According to various embodiments of the present disclosure, the memory130 may further store instructions to instruct the processor 120 toremove the inertial force component which corresponds to a linearcomponent of the motion information when the instructions are executed.

According to various embodiments of the present disclosure, the memory130 may further store instructions to instruct the processor 120 tocontrol the display to display the screen in accordance with a rotationcomponent of the motion information when the instructions are executed.

The electronic device 101 may further include a camera module (notshown) captures a plurality of images of an external environment of theelectronic device and outputs the plurality of images to the processor.According to various embodiments of the present disclosure, the memory130 may further store instructions to instruct the processor 120 toremove the inertial force component which corresponds to motioninformation acquired while adjacent images of the plurality of imagesare not changed when the instructions are executed.

According to various embodiments of the present disclosure, the memory130 may further store instructions to instruct the processor 120 toacquire motion information of the electronic device based on adifference between adjacent images of the plurality of images and tocontrol the display to display a screen corresponding to the acquiredmotion information when the instructions are executed.

According to various embodiments of the present disclosure, the memory130 may further store instructions to instruct the processor 120 toacquire motion information of the electronic device based on a relativelocation of the electronic device with respect to the other electronicdevice and to control the display to display a screen corresponding tothe acquired motion information when the instructions are executed.

FIG. 2 illustrates a block diagram of an electronic device 201 accordingto various embodiments. The electronic device 201 may include, forexample, the whole or part of the electronic device 101 illustrated inFIG. 1. The electronic device 201 may include at least one applicationprocessor (AP) 210, a communication module 220, a subscriberidentification module 224, a memory 230, a sensor module 240, an inputdevice 250, a display 260, an interface 270, an audio module 280, acamera module 291, a power management module 295, a battery 296, anindicator 297, and a motor 298.

The processor 210 may drive, for example, an operating system orapplication programs to control a plurality of hardware or softwareelements connected thereto and to perform various types of dataprocessing and operations. The processor 210 may be implemented by, forexample, a system on chip (SoC). According to an embodiment, theprocessor 210 may further include a graphic processing unit (GPU) and/oran image signal processor. The processor 210 may also include at leastsome (for example, a cellular module 221) of the elements illustrated inFIG. 2. The processor 210 may load, in a volatile memory, commands ordata received from at least one of the other elements (for example, anon-volatile memory) to process the commands or data, and may storevarious types of data in the non-volatile memory.

The communication module 220 may have a configuration equal or similarto that of the communication interface 170 of FIG. 1. The communicationmodule 220 may include, for example, a cellular module 221, a Wi-Fimodule 223, a Bluetooth® (BT) module 225, a GNSS module 227 (forexample, a GPS module, a GLONASS module, a BeiDou module, or a GALILEOmodule), an NFC module 228, and a radio frequency (RF) module 229.

The cellular module 221 may provide a voice call, an image call, a textmessage service, or an Internet service through, for example, acommunication network. According to an embodiment, the cellular module221 may identify and authenticate the electronic device 201 within acommunication network using a subscriber identification module 224 (forexample, a SIM card). According to an embodiment, the cellular module221 may perform at least some of the functions, which can be provided bythe processor 210. According to an embodiment of the present disclosure,the cellular module 221 may include a communication processor (CP).

Each of the Wi-Fi module 223, the BT module 225, the GNSS module 227,and the NFC module 228 may include, for example, a processor forprocessing data transmitted/received through the corresponding module.According to some embodiments, at least some (two or more) of thecellular module 221, the Wi-Fi module 223, the BT module 225, the GNSSmodule 227, and the NFC module 228 may be included in one integratedchip (IC) or IC package.

The RF module 229 may transmit/receive, for example, a communicationsignal (for example, an RF signal). The RF module 229 may include, forexample, a transceiver, a power amp module (PAM), a frequency filter, alow noise amplifier (LNA), or an antenna. According to anotherembodiment of the present disclosure, at least one of the cellularmodule 221, the Wi-Fi module 223, the BT module 225, the GNSS module227, and the NFC module 228 may transmit/receive an RF signal through aseparate RF module.

The subscriber identification module 224 may include, for example, acard including a subscriber identity module (SIM) and/or an embeddedSIM, and may contain unique identification information (for example, anintegrated circuit card identifier (ICCID)) or subscriber information(for example, an international mobile subscriber identity (IMSI)).

The memory 230 (for example, the memory 130) may include, for example,an internal memory 232 or an external memory 234. The internal memory232 may include at least one of, for example, a volatile memory (forexample, a dynamic random access memory (DRAM), a static RAM (SRAM), asynchronous dynamic RAM (SDRAM), and the like) and a non-volatile memory(for example, a one-time programmable read only memory (OTPROM), aprogrammable ROM (PROM), an erasable and programmable ROM (EPROM), anelectrically erasable and programmable ROM (EEPROM), a mask ROM, a flashROM, a flash memory (for example, a NAND flash memory, a NOR flashmemory, and the like), a hard disk drive, and a solid state drive(SSD)).

An external memory 234 may further include a flash drive, for example, acompact flash (CF), a secure digital (SD), a micro secure digital(micro-SD), a mini secure digital (Mini-SD), an eXtreme Digital (xD), amulti-media card (MMC), a memory stick, or the like. The external memory234 may be functionally and/or physically connected to the electronicdevice 201 through various interfaces.

The sensor module 240 may measure a physical quantity or detect anoperation state of the electronic device 201, and may convert themeasured or detected information into an electrical signal. The sensormodule 240 may include, for example, at least one of a gesture sensor240A, a gyro sensor 240B, an atmospheric pressure sensor 240C, amagnetic sensor 240D, an acceleration sensor 240E, a grip sensor 240F, aproximity sensor 240G, a color sensor 240H (for example, a red, green,blue (RGB) sensor), a biometric sensor 240I, a temperature/humiditysensor 240I, a light sensor 240K, and a ultraviolet (UV) sensor 240M.Additionally or alternatively, the sensor module 240 may include, forexample, an E-nose sensor, an electromyography (EMG) sensor, anelectroencephalogram (EEG) sensor, an electrocardiogram (ECG) sensor, aninfrared (IR) sensor, an iris sensor, and/or a fingerprint sensor. Thesensor module 240 may further include a control circuit for controllingone or more sensors included therein. In some embodiments, theelectronic device 201 may further include a processor, which isconfigured to control the sensor module 240, as a part of the processor210 or separately from the processor 210 in order to control the sensormodule 240 while the processor 210 is in a sleep state.

The input device 250 may include, for example, a touch panel 252, a(digital) pen sensor 254, a key 256, and/or an ultrasonic input unit258. The touch panel 252 may use, for example, at least one of acapacitive type, a resistive type, an infrared type, and an ultrasonictype. Further, the touch panel 252 may further include a controlcircuit. The touch panel 252 may further include a tactile layer toprovide a tactile reaction to a user.

The (digital) pen sensor 254 may include, for example, a recognitionsheet which is a part of the touch panel or is separated from the touchpanel. The key 256 may include, for example, a physical button, anoptical key or a keypad. The ultrasonic input device 258 may detectultrasonic waves generated by an input tool through a microphone (forexample, a microphone 288) and identify data corresponding to thedetected ultrasonic waves.

The display 260 (for example, the display 160) may include a panel 262,a hologram device 264 or a projector 266. The panel 262 may include aconfiguration identical or similar to that of the display 160illustrated in FIG. 1. The panel 262 may be implemented to be, forexample, flexible, transparent, or wearable. The panel 262 and the touchpanel 252 may be implemented as one module. The hologram 264 may show athree dimensional image in the air by using an interference of light.The projector 266 may display an image by projecting light onto ascreen. The screen may be located, for example, in the interior of or onthe exterior of the electronic device 201. According to an embodiment,the display 260 may further include a control circuit for controllingthe panel 262, the hologram device 264, or the projector 266.

The interface 270 may include, for example, a high-definition multimediainterface (HDMI) 272, a universal serial bus (USB) 274, an opticalinterface 276, or a D-subminiature (D-sub) 278. The interface 270 may beincluded in, for example, the communication interface 170 illustrated inFIG. 1. Additionally or alternatively, the interface 270 may include,for example, a mobile high-definition link (MHL) interface, a securedigital (SD) card/multi-media card (MMC) interface, or an infrared dataassociation (IrDA) standard interface.

The audio module 280 may bilaterally convert, for example, a sound andan electrical signal. At least some elements of the audio module 280 maybe included in, for example, the input/output interface 145 illustratedin FIG. 1. The audio module 280 may process sound information which isinput or output through, for example, a speaker 282, a receiver 284,earphones 286, the microphone 288 or the like.

The camera module 291, which can take a still image and a moving image,may include one or more image sensors (for example, a front or rearsensor), a lens, an image signal processor (ISP), or a flash (forexample, an LED, a xenon lamp, or the like) according to an embodiment.

The power management module 295 may manage, for example, power of theelectronic device 201. According to an embodiment, the power managementmodule 295 may include a power management integrated circuit (PMIC), acharger IC, or a battery fuel gauge. The PMIC may use a wired and/orwireless charging method. Examples of the wireless charging method mayinclude, for example, a magnetic resonance method, a magnetic inductionmethod, an electromagnetic method, and the like. Additional circuits(for example, a coil loop, a resonance circuit, a rectifier, etc.) forwireless charging may be further included. The battery gauge maymeasure, for example, a residual quantity of the battery 296, and avoltage, a current, or a temperature during the charging. The battery296 may include, for example, a rechargeable battery and/or a solarbattery.

The indicator 297 may display a specific state, for example, a bootingstate, a message state, a charging state, of the electronic device 201or a part of the electronic device 201 (for example, the processor 210).The motor 298 may convert an electrical signal into mechanicalvibrations, and may generate a vibration or haptic effect. Although notillustrated, the electronic device 201 may include a processing unit(for example, a GPU) for supporting a mobile television (TV). Theprocessing unit for supporting mobile TV may process media dataaccording to a standard, such as, for example, digital multimediabroadcasting (DMB), digital video broadcasting (DVB), MediaFLO™, or thelike.

Each of the above-described component elements of hardware according tothe present disclosure may be configured with one or more components,and the names of the corresponding component elements may vary based onthe type of electronic device. The electronic device according toembodiments of the present disclosure may include at least one of theaforementioned elements. Some elements may be omitted or otheradditional elements may be further included in the electronic device.Also, some of the hardware components according to embodiments may becombined into one entity, which may perform functions identical to thoseof the relevant components before the combination.

FIG. 3 illustrates a block diagram of a program module according toembodiments of the present disclosure. According to an embodiment, theprogram module 310 (for example, the program 140) may include anoperating system (OS) for controlling resources related to theelectronic device (for example, the electronic device 101) and/orvarious applications (for example, the application programs 147)executed in the operating system. The operating system may be, forexample, Android®, iOS®, Windows®, Symbian®, Tizen®, Samsung Bada OS®,or the like.

The program module 310 may include a kernel 320, middleware 330, anapplication programming interface (API) 360, and/or an application 370.At least some of the program module 310 may be preloaded on theelectronic device, or may be downloaded from an external electronicdevice (for example, the electronic device 102 or 104, or the server106).

The kernel 320 (for example, the kernel 141) may include, for example, asystem resource manager 321 and/or a device driver 323. The systemresource manager 321 may control, assign, or collect system resources.According to an embodiment, the system resource manager 321 may includea process manager, a memory manager, or a file system manager. Thedevice driver 323 may include, for example, a display driver, a cameradriver, a Bluetooth driver, a shared-memory driver, a USB driver, akeypad driver, a Wi-Fi driver, an audio driver, or an inter-processcommunication (IPC) driver.

The middleware 330 may provide a function required by the applications370 in common or provide various functions to the applications 370through the API 360 so that the applications 370 can efficiently uselimited system resources within the electronic device. According to anembodiment, the middleware 330 (for example, the middleware 143) mayinclude, for example, at least one of a runtime library 335, anapplication manager 341, a window manager 342, a multimedia manager 343,a resource manager 344, a power manager 345, a database manager 346, apackage manager 347, a connectivity manager 348, a notification manager349, a location manager 350, a graphic manager 351, and a securitymanager 352.

The runtime library 335 may include a library module that a compileruses in order to add a new function through a programming language whilethe applications 370 are being executed. The runtime library 335 mayperform input/output management, memory management, or a function for anarithmetic function.

The application manager 341 may, for example, manage a life cycle of atleast one of the applications 370. The window manager 342 may managegraphical user interface (GUI) resources used on a screen. Themultimedia manager 343 may identify formats required for thereproduction of various media files and encode or decode a media fileusing a codec suitable for the corresponding format. The resourcemanager 344 may manage resources of at least one of the applications370, such as a source code, a memory, and a storage space.

The power manager 345 may operate together with, for example, a basicinput/output system (BIOS) to manage a battery or power and may providepower information required for the operation of the electronic device.The database manager 346 may generate, search, or change a database tobe used in at least one of the applications 370. The package manager 347may manage the installation or the updating of an applicationdistributed in the form of a package file.

The connectivity manager 348 may manage a wireless connection such as,for example, Wi-Fi or BT. The notification manager 349 may display ornotify of an event, such as an arrival message, an appointment,proximity notification, and the like, in such a manner of not disturbinga user. The location manager 350 may manage location information of theelectronic device. The graphic manager 351 may manage a graphic effectto be provided to a user and a user interface relating to the graphiceffect. The security manager 352 may provide all security functionsrequired for system security or user authentication. According to anembodiment, when the electronic device (for example, the electronicdevice 101) has a telephone call function, the middleware 330 mayfurther include a telephony manager for managing a voice call functionor a video call function of the electronic device.

The middleware 330 may include a middleware module that formscombinations of various functions of the above described elements. Themiddleware 330 may provide specialized modules according to types ofoperating systems in order to provide differentiated functions.Furthermore, the middleware 330 may dynamically remove some of theexisting elements, or may add new elements.

The API 360 (for example, the API 145) is, for example, a set of APIprogramming functions, and may be provided with a differentconfiguration according to an OS. For example, in the case of Android®or iOS®, one API set may be provided for each platform, and in the caseof Tizen®, two or more API sets may be provided for each platform.

The applications 370 (for example, the application programs 147) mayinclude, for example, one or more applications that can performfunctions, such as home 371, dialer 372, short message service(SMS)/multimedia message service (MMS) 373, instant message (IM) 374,browser 375, camera 376, alarm 377, contacts 378, voice dialer 379,e-mail 380, calendar 381, media player 382, album 383, clock 384, healthcare (for example, measure exercise quantity or blood sugar), orenvironment information (for example, atmospheric pressure, humidity,temperature information or the like).

According to an embodiment, the applications 370 may include anapplication (hereinafter, referred to as an “information exchangeapplication” for convenience of description) supporting informationexchange between the electronic device (for example, the electronicdevice 101) and an external electronic device (for example, theelectronic device 102 or 104). The application associated with theexchange of information may include, for example, a notification relayapplication for transferring specific information to an externalelectronic device, or a device management application for managing anexternal electronic device.

For example, the notification relay application may include a functionof transferring, to the external electronic device (for example, theelectronic device 102 or 104), notification information generated fromother applications of the electronic device 101 (for example, an SMS/MMSapplication, an e-mail application, a health management application, oran environmental information application). Furthermore, the notificationrelay application may, for example, receive notification informationfrom an external electronic device and provide the received notificationinformation to a user.

The device management application may manage (for example, install,delete, or update) at least one function of an external electronicdevice (for example, the electronic device 102 or 104, or the server106) communicating with the electronic device (for example, a functionof turning on/off the external electronic device itself (or somecomponents) or a function of adjusting luminance (or a resolution) ofthe display), applications operating in the external electronic device,or services provided by the external electronic device (for example, acall service and a message service).

According to an embodiment, the applications 370 may includeapplications (for example, a health care application of a mobile medicalappliance or the like) designated according to attributes of theexternal electronic device 102 or 104. According to an embodiment, theapplications 370 may include an application received from the externalelectronic device (for example, the server 106, or the electronic device102 or 104). According to an embodiment, the applications 370 mayinclude a preloaded application or a third party application which canbe downloaded from the server. Names of the elements of the programmodule 310, according to the above-described embodiments of the presentdisclosure, may change depending on the type of OS.

According to exemplary embodiments of the present disclosure, at leastsome of the program module 310 may be implemented in software, firmware,hardware, or a combination of two or more thereof. At least some of theprogram module 310 may be implemented (e.g., executed) by, for example,the processor (e.g., the processor 210). At least some of the programmodule 310 may include, for example, a module, a program, a routine, aset of instructions, and/or a process for performing one or morefunctions.

FIG. 4A illustrates a perspective view illustrating the electronicdevice 101 and the electronic device 102 according to an embodiment ofthe present disclosure.

The electronic device 101 may include a display. The electronic device101 may store a virtual reality application. The virtual realityapplication may be an application which can provide a display similar toan actual reality to the user. According to an embodiment, the virtualreality application may display a left eye image and a right eye imagecorresponding to each of the user's eyes based on a stereo scheme.

The electronic device 102 may be a head mounted theater (HMT) device.The HMT device may be mounted on a user's head and fixed to the user'shead even though the user moves. Further, the HMT device may also fixthe electronic device 101 and thus the user may view an image displayedon the electronic device 101.

The electronic device 102 according to an embodiment may include ahousing 450 provided to be worn on the user's head, a blackout part 430fixed to the housing and provided at an area corresponding to locationsof the user's eyes, and at least one input button 421 provided at onearea of the housing 450. The electronic device 102 may include an inputpad 425 which may receive a swipe input from the user.

The user may position the user's eyes to fit closely to the blackoutpart 430 and, accordingly, the user may view the image by the virtualreality application provided from the electronic device 101 without anyinterference from external light.

The electronic device 101 may be coupled to the electronic device 102.The electronic device 101 may be connected to the electronic device 102through a wire or wirelessly. For example, although the electronicdevice 101 may be connected to the electronic device 102 based on a USB,it is merely an example and it may be easily understood by those skilledin the art that there is no limitation on the connection if datatransmission/reception between the two devices 101 and 102 is possiblethrough the connection. According to another embodiment, the electronicdevice 101 may be simply physically coupled to the electronic device102.

FIG. 4B illustrates the displaying operation of the electronic deviceaccording to an embodiment.

As illustrated in FIG. 4B, the electronic device 101 may display a lefteye image 461 and a right eye image 462 on the display 160. The left eyeimage 461 may include a first object 463 and the right eye image 462 mayinclude a second object 464. The first object 463 may correspond to aleft eye 701 and the second object 464 may correspond to a right eye702. In FIG. 4B, an interpupillary Distance (IPD) corresponding to adistance between the left eye 701 and the right eye 702 may be D. Theleft eye image 461 and the right eye image 462 may correspond to theuser's two eyes and may be images viewed by the user while the userfeels a sense of depth. According to embodiments of the presentdisclosure, the left eye image 461 and the right eye image 462 may beimages for the virtual reality service, and may be images configured togive a three-dimensional effect to a part of the entire screen for thevirtual reality service.

The electronic device 101 may display the first object 463 and thesecond object 464 with a predetermined distance therebetween. The usermay view as if an object image 467 exists at the intersection of astraight line passing through the left eye 701 and the first object 463and a straight line passing through the right eye 702 and the secondobject 464. For example, the user may view as if the object image existsat a position spaced apart from the user by Ll.

According to an embodiment, the electronic device 101 may display thefirst object 463 and the second object 464, which have a loop shape.

FIG. 4C illustrates a conceptual diagram of the screen viewed by theuser. As illustrated in FIG. 4C, the user may view the screen includinga loop-shaped image 471.

Meanwhile, although FIGS. 4A to 4C illustrate that the electronic device101 is separated from the electronic device 102, which the user wears,it is merely an example and the electronic device 101 may be implementedto be integral with the electronic device 102.

FIG. 5A illustrates a perspective view illustrating the user wearing theHMT device.

The user may wear the housing on the head. Further, the electronicdevice 101 may be coupled to the electronic device 102, and the user mayview an image displayed on the display of the electronic device 101.

The electronic device 101 may display a left eye image and a right eyeimage on respective left and right parts of the display. The left eyeimage may be incident to the user's left eye and the right eye image maybe incident to the user's right eye. For example, the left eye image andthe right eye image may be incident to the user's entire field of viewthrough both eyes. The user may receive a virtual reality service byviewing the images incident to both eyes.

The virtual reality application executed by the electronic device 101may display a binocular image on the display. The virtual realityapplication may change and display the binocular image according to amotion (yaw, pitch, or roll) of the user or the electronic device 102.

The electronic device 102 may receive a command from the user by atleast one of the input button 421 and/or the input pad 425. For example,the electronic device 101 may acquire a focus control command or amanipulation command from the electronic device 102. According toanother embodiment, the user may directly input the focus controlcommand or the manipulation command into the electronic device 101.

For example, when the user inputs a swipe gesture in a first directionof the input pad 425, the electronic device 101 may execute a controlcommand corresponding to the swipe gesture.

FIGS. 5B to 5E illustrate conceptual diagrams illustrating screenswitching of the electronic device according to embodiments of thepresent disclosure.

As illustrated in FIG. 5B, the user may look in a first direction 511 ina state where the user wears the electronic device 101. The electronicdevice 101 may display a left eye image and a right eye image for afirst virtual screen 521 to allow the user to view the first virtualscreen 521. The first virtual screen 521 may be a screen correspondingto a part of the entire screen configured in the virtual realityservice. Meanwhile, the user may turn the user's head in a rightdirection 501, and the electronic device 101 may sense the rotation inthe right direction 501. As illustrated in FIGS. 5C to 5E, the user mayturn the user's head in a second direction 512, a third direction 513,and a fourth direction 514 from the first direction 511. The electronicdevice 101 may sense the rotation 501 in the fourth direction 514 fromthe first direction 511. The electronic device 101 may change anddisplay the first virtual screen 521 in response to the rotation 501.For example, the electronic device 101 may display a second virtualscreen 522 in accordance with the second direction 512, a third virtualscreen 523 in accordance with the third direction 513, and a fourthvirtual screen 524 in accordance with the fourth direction 514. Morespecifically, the electronic device 101 may display the left eye imageand the right eye image for displaying the virtual screens,respectively. Each of the first virtual screen 521 to the fourth virtualscreen 524 may be a partial screen of the entire screen for the virtualreality service. As illustrated in FIGS. 5B to 5E, the second virtualscreen 522 may be a screen for a foreground arranged relatively on theright side of the first virtual screen 521, the third virtual screen 523may be a screen for a foreground arranged relatively on the right sideof the second virtual screen 522, and the fourth virtual screen 524 maybe a screen for a foreground arranged relatively on the right side ofthe third virtual screen 523. Accordingly, as the user turns the user'shead in a right direction, the user may sequentially view theforegrounds arranged relatively on the right side.

FIGS. 6A to 6C illustrate conceptual diagrams illustrating an operationof the electronic device according to embodiments of the presentdisclosure.

As illustrated in FIG. 6A, a user 601 may board a transportation meanssuch as a car while wearing the electronic device 101. In this case, thetransportation means may accelerate in a first direction. For example,it is assumed that the transportation means accelerates with anacceleration 611 with a vector having coordinates (a1, b1, c1). (a1, b1,c1) may be coordinates based on a predetermined point of a non-inertialframe for the transportation means, and the components may indicatesizes and directions of the x, y, and z axis components of theacceleration, respectively. For example, each of a1, b1, and c1 may havea positive value or a negative value. Meanwhile, the electronic device101 may be included in an inertial frame corresponding to thetransportation means and, accordingly, an inertial force 612 may beapplied to the electronic device 101. The inertial force 612 may beapplied in a direction opposite to the first direction. Meanwhile, aninertial acceleration of the inertial force 612 may have the sameabsolute value as that of the acceleration of the transportation means.That is, the inertial acceleration of the inertial force 612 may have avector value of (−a1, −b1, −c1). Meanwhile, although FIG. 6A illustratesthat the linear inertial acceleration is applied to the electronicdevice 101, it is merely an example and a rotational inertia angularacceleration may be applied to the electronic device 101.

As illustrated in FIG. 6B, the electronic device 101 may display apartial image 621 of a total image 620 such as a panorama on thedisplay. For example, as illustrated in FIG. 6C, the electronic device101 may display a left eye image 631 corresponding to a first image 621,which is a partial image, on a left half side of the display and displaya right eye image 632 corresponding to the partial image 621 on a righthalf side of the display.

It is assumed that the user is viewing the first image 621 without anymovement. Since the user is not moving while wearing the electronicdevice 101, the electronic device 101 should maintain displaying of theleft eye image 631 and the right eye image 632 corresponding to thefirst image 621. However, as described above, the electronic device 101may receive the inertial force 612 in the direction opposite to thefirst direction. The motion information sensing module of the electronicdevice 101 may sense the inertial force 612 as a motion of theelectronic device 101 by the user. That is, the electronic device 101may change the displayed images 631 and 632 in accordance with theinertial force 612. The electronic device 101 may determine a secondimage 622 to be changed in the total image 620 by the inertial force612. The electronic device 101 may determine the second image 622 basedon the direction and size of the inertial force 612. The electronicdevice 101 may display a left eye image 641 and a right eye image 642corresponding to the second image 622. Accordingly, even though the user601 desires to view the first image 621, the user views the second image622 due to the inertial force 612.

FIG. 7 illustrate a flowchart illustrating a control method of theelectronic device according to embodiments of the present disclosure.

In operation 710, the electronic device 101 may acquire motioninformation of the electronic device 101. The electronic device 101 mayinclude sensors such as a linear acceleration sensor, a gyro sensor,and/or a geomagnetic sensor, which may sense various linearaccelerations, rotation angle accelerations, and/or orientationinformation of the electronic device. The electronic device 101 mayacquire motion information of the electronic device 101 based on outputvalues from the various sensors. For example, the electronic device 101may acquire a linear acceleration of the electronic device 101 based onthe output value from the linear acceleration sensor. The electronicdevice 101 may acquire a rotation angle acceleration of the electronicdevice 101 based on the output value from the gyro sensor. Theelectronic device 101 may acquire a motion in orientation information onthe electronic device 101 based on the output value from each of thegyro sensor and the geomagnetic sensor.

In operation 720, the electronic device 101 may perform an inertialforce correction on the acquired motion information. The electronicdevice 101 may remove the inertial force component from the acquiredmotion information and, accordingly, acquire the inertialforce-corrected motion information. According to an embodiment, theelectronic device 101 may acquire the inertial force information andperform the inertial force correction. According to an embodiment, theelectronic device 101 may receive inertial force information fromanother electronic device including the sensor and perform the inertialforce correction by using the received inertial force information.According to an embodiment, the electronic device 101 may generate aninverse vector in accordance with the acquired inertial forceinformation and acquire the inertial force-corrected motion informationby adding the inverse vector and the acquired motion information.According to an embodiment, the electronic device 101 may measure abiometric signal and perform the inertial force correction by using themeasured biometric signal. According to an embodiment, the electronicdevice 101 may determine whether an absolute value of the motioninformation is included in a preset range and perform the inertial forcecorrection according to a result of the determination. According to anembodiment, the electronic device 101 may perform the inertial forcecorrection by removing a linear component of the motion information.According to an embodiment, the electronic device 101 may photograph anexternal environment and perform the inertial force correction by usingthe photographed image. According to an embodiment, the electronicdevice 101 may perform the inertial force correction based on whetherorientation information of the electronic device 101 is changed. Theinertial force correction according to the embodiments will be describedbelow in more detail.

In operation 730, the electronic device 101 may display a virtualreality screen by using the inertial force-corrected motion information.That is, the electronic device 101 may display the virtual realityscreen by using motion information acquired from the user's intention.Accordingly, the user may view the intended virtual reality screen whilethe transportation means in which the user has boarded accelerates.

Meanwhile, the other electronic device may be included in, for example,an airplane. In this case, the other electronic device may transmitinformation such as an acceleration, altitude, and/or terrestrialmagnetism to the electronic device 101. The electronic device 101 mayperform the correction based on the received information such as theacceleration, altitude, and/or terrestrial magnetism.

FIGS. 8A to 8C illustrate conceptual diagrams illustrating an operationof the electronic device according to embodiments of the presentdisclosure.

In FIG. 8A, it is assumed that the user 601 boards the transportationmeans like in FIG. 6A. Further, the electronic device 101 may receivethe inertial force 612 like in FIG. 6A. As illustrated in FIG. 6A, theinertial acceleration corresponding to the inertial force 612 may havethe vector value of (−a1, −b1, −c1). Meanwhile, the user may turn theuser's head to the right while wearing the electronic device 101.Accordingly, the electronic device 101 may sense a motion 810 of theelectronic device 101 and acquire motion information. Here, it isassumed that an acceleration corresponding to the motion 810 is (a2, b2,c2). Accordingly, the acceleration corresponding to the motioninformation of the electronic device 101, which the electronic device101 acquires, may be (a2-a1, b2-b1, c2-c1) generated by adding theinertial acceleration (−a1, −b1, −c1) and the acceleration (a2, b2, c2)corresponding to the motion 810. (a2-a1, b2-b1, c2-c1) is named an addedacceleration 811. For example, the added acceleration 811 may be theleft side from the user.

The electronic device 101 may display a left eye image and a right eyeimage corresponding to a first image 811. Meanwhile, the electronicdevice 101 may display a left eye image and a right eye imagecorresponding to a second image 812 in accordance with the addedacceleration 811. Accordingly, even though the user turns the user'shead relatively to the right, the user views the second image 812arranged relatively on the left side of the first image 811.

The electronic device 101 according to embodiments of the presentdisclosure may ignore the inertial acceleration corresponding to theinertial force 612 and adopt the acceleration corresponding to a motion810 actually intended by the user as motion information. The electronicdevice 101 may acquire inertial force-corrected motion information byperforming the inertial force correction through the various methodsand, accordingly, display a third image 813 corresponding to the motion810. For example, as illustrated in FIG. 8C, the electronic device 101may change a left eye image 821 and a right eye image 822 correspondingto the first image 811 and display a left eye image 831 and a right eyeimage 832 corresponding to the third image 813.

In the above description, the electronic device 101 may perform theinertial force correction on the sensed motion information and displaythe screen based on the inertial force-corrected motion information.Hereinafter, various inertial force correction methods performed by theelectronic device 101 will be described in more detail.

FIG. 9 illustrate a flowchart illustrating an inertial force correctionmethod according to embodiments of the present disclosure.

In operation 910, the electronic device 101 may sense motioninformation. The electronic device 101 may include sensors such as alinear acceleration sensor, a gyro sensor, and a geomagnetic sensor,which may sense various linear accelerations, rotation angleaccelerations, or orientation information of the electronic device. Theelectronic device 101 may acquire motion information of the electronicdevice 101 based on output values from the various sensors.

In operation 920, a sensor 900 may sense an inertial force. The sensor900 may be physically separated from the electronic device 101 and maybe included in an inertial frame corresponding to a transportationmeans. The sensor 900 may be independent from an operation for movingthe electronic device 101 by the user. For example, when the userperforms an operation of rotating the head while wearing the electronicdevice 101, a location of the sensor 900 is not influenced by theoperation by the user. The sensor 900 may sense the inertial force bythe acceleration of the transportation means. The sensor 900 may includesensors such as a linear acceleration sensor, a gyro sensor, and/or ageomagnetic sensor which may sense various linear accelerations,rotation angle accelerations, and/or orientation information of theelectronic device. The sensor 900 may sense the inertial force based onoutput values from the various sensors.

In operation 930, the sensor 900 may transmit the sensed inertial forceinformation to the electronic device 101. The sensor 900 may transmitthe sensed inertial force information to the electronic device 101through wired or wireless communication.

In operation 940, the electronic device 101 may correct the sensedmotion information by using the received inertial force information. Theelectronic device 101 may perform the inertial force correction byremoving the inertial force component from the sensed motioninformation. The electronic device 101 may perform the inertial forcecorrection by adding an inverse vector of the inertial force informationand the sensed motion information. For example, in embodiments of theFIGS. 8A and 8B, accelerations corresponding to the sensed motioninformation may be (a2-a1, b2-b1, c2-c1). Further, the sensor 900 maysense the inertial acceleration of (−a1, −b1, −c1). The electronicdevice 101 may receive the inertial acceleration of (−a1, −b1, −c1) fromthe sensor 900. The electronic device 101 may acquire the accelerationof (a2, b2, c2) of the corrected motion information by adding theinverse vector (a1, b1, c1) of the inertial acceleration and theacceleration (a2-a1, b2-b1, c2-c1) corresponding to the sensed motioninformation.

In operation 950, the electronic device 101 may display a virtualreality screen by using the corrected motion information. Accordingly,as illustrated in FIG. 8C, the electronic device 101 may display theleft eye image 831 and the right eye image 832 corresponding to theacceleration (a2, b2, c2) of the corrected motion information.

FIG. 10 illustrate a conceptual diagram illustrating the electronicdevice and another electronic device according to embodiments of thepresent disclosure.

As illustrated in FIG. 10, the user may board a transportation meanswhile wearing the electronic device 101. Further, the user may wearanother electronic device 1030 on the user's wrist. Although the otherelectronic device 1030 is illustrated as a wristwatch-type wearableelectronic device, the other electronic device 1030 is not limited tothe wristwatch-type wearable electronic device if the other electronicdevice 1030 is a device which is physically separated from theelectronic device 101 and who's location is not influenced by a user'smotion 1010. The user, the electronic device 101, and the otherelectronic device 1030 may be included in the same inertial frame.

Meanwhile, the transportation means may accelerate and, accordingly, theinertial force may be applied to all objects within the transportationmeans, that is, the user, the electronic device 101, and the otherelectronic device 1030. For example, a first inertial force 1020 may beapplied to the electronic device 101 and a second inertial force 1040may be applied to the other electronic device 1030. The first inertialforce 1020 and the second inertial force 1040 may be proportional tomasses of the electronic device 101 and the other electronic device1030, respectively. The inertial acceleration corresponding to the firstinertial force 1020 and the acceleration force corresponding to thesecond inertial force 1030 may be the same.

The user may rotate the user's head in a first direction as indicated byreference numeral 1010. Accordingly, the electronic device 101 may sensea result of a sum of motion information corresponding to the rotation1010 in the first direction and motion information corresponding to thefirst inertial force 1020. A location of the other electronic device1030 is not influenced by the user's motion, that is, the rotation 1010.Accordingly, the other electronic device 1030 may sense the secondinertial force 1040. The other electronic device 1030 may transmitinformation on the second inertial force 1040 to the electronic device101 as indicated by reference numeral 1050. The information on thesecond inertial force 1040 may be the inertial acceleration or aninverse vector of the inertial acceleration. The electronic device 101may acquire inertial force-corrected motion information by adding theinverse vector of the inertial acceleration and the acceleration of thesensed motion information.

Meanwhile, the other electronic device 1030 may be implemented in theform fixed to the transportation means as well as that separately wornby the user in the embodiment. For example, the user may fix the otherelectronic device 1030 to the inertial frame of the transportationmeans. Alternatively, the other electronic device 1030 may be includedin the transportation means. For example, the transportation means mayinclude a sensor that may sense motion information of the transportationmeans and a communication module that may transmit the sensed motioninformation of the transportation means. In this case, the electronicdevice 101 may receive the motion information of the transportationmeans from the transportation means and perform a inertial forcecorrection by using the motion information. When the electronic device101 receives the motion information of the transportation means, theelectronic device 101 may acquire the inertial force-corrected motioninformation by adding the acceleration corresponding to the motioninformation of the transportation means and the accelerationcorresponding to the sensed motion information of the electronic device101 without using the inverse vector. This results from the fact thatthe motion information of the transportation means and the inertialforce have completely opposite directions.

FIGS. 11A and 11B illustrate flowcharts illustrating a control method ofthe electronic device according to embodiments of the presentdisclosure.

In operation 1110, the electronic device 101 may sense an accelerationof the electronic device 101. In operation 1120, another electronicdevice may sense an inertial acceleration. In operation 1130, the otherelectronic device may transmit the sensed inertial acceleration to theelectronic device 101. In operation 1140, the electronic device 101 maygenerate a corrected vector by adding the sensed acceleration and aninverse vector of the received inertial acceleration. The correctedvector may be an acceleration that corresponds to a user's motion. Inoperation 1150, the electronic device 101 may display a virtual realityscreen by using the corrected vector.

Meanwhile, on contrary to FIG. 11A, the other electronic device maytransmit the inverse vector of the sensed inertial acceleration in anembodiment of FIG. 11B. That is, the other electronic device maygenerate and transmit the inverse vector of the inertial acceleration.The other electronic device may transmit the inverse vector of theinertial acceleration in operation 1131, and the electronic device 101may generate the corrected vector by adding the sensed acceleration andthe received inverse vector in operation 1141.

FIG. 12 illustrate a flowchart illustrating a control method of theelectronic device according to embodiments of the present disclosure.The embodiment of FIG. 12 will be described in more detail withreference to FIGS. 13A and 13B. FIGS. 13A and 13B illustrate conceptualdiagrams illustrating an inertial correction using a biometric signalaccording to embodiments of the present disclosure.

In operation 1210, the electronic device 101 may sense motioninformation of the electronic device. As described above, the electronicdevice 101 may include sensors such as a linear acceleration sensor, agyro sensor, and a geomagnetic sensor, which may sense various linearaccelerations, rotation angle accelerations, or orientation informationof the electronic device. The electronic device 101 may acquire motioninformation of the electronic device 101 based on output values from thevarious sensors.

In operation 1220, the electronic device 101 may sense a biometricsignal. According to an embodiment, the electronic device 101 may sensean electromyograph (EMG) signal. The EMG signal relates to electricalactivity of a user's muscle and indicates electrical activity through acontraction or relaxation of the muscle. Since the muscle is under thecontrol of a nerve and minute electric currents always flow in themuscle, information on the contraction or relaxation of the muscle maybe analyzed by identifying the electric currents through electrodes.Meanwhile, it may be easily understood by those skilled in the art thatthere is no limitation in the type of signal if the signal can indicatea muscle movement state as well as the EMG signal.

In operation 1230, the electronic device 101 may determine whether thesensed motion information of the electronic device 101 is intended bythe user based on the biometric signal. In operation 1240, theelectronic device 101 may display a virtual reality screen by using aresult of the determination.

For example, the electronic device 101 may determine motion informationacquired while the biometric signal is not acquired as motioninformation by the inertial force. As illustrated in FIG. 13A, theelectronic device 101 may receive the inertial force 612. Further, it isassumed that the electronic device 101 displays a left eye image and aright eye image corresponding to the first image 811. A sensor 1300which may sense a biometric signal may be arranged near a user's neck,for example, attached to a strap. Accordingly, when the user turns theuser's head, the sensor 1300 may sense a change in the biometric signalgenerated due to the contraction and relaxation of muscles. For example,when the user does not turn the user's head as illustrated in FIG. 13A,the sensor 1300 may not sense the biometric signal corresponding to themuscle movement. The electronic device 101 may sense motion informationof the electronic device 101 including the inertial force 612 butdetermine that the motion information does not correspond to a motionintended by the user. That is, the electronic device 101 may not processthe motion information acquired when the biometric signal is not sensed.The sensor 1300 may be included in an HMT device into which theelectronic device may be inserted and, in this case, the electronicdevice 101 may receive information on the biometric signal from the HMTdevice through a wire or wirelessly.

Meanwhile, as illustrated in FIG. 13B, the user may turn the user's headto the right. In this case, the sensor 1300 may sense a biometric signalcorresponding to the muscle movement. The electronic device 101 maydetermine motion information 810 acquired when the biometric signal issensed as motion information intended by the user. Accordingly, theelectronic device 101 may change the virtual reality screen from thefirst image 811 to the third image 813 in accordance with the motioninformation 810 and display a left eye image and a right eye imagecorresponding to the third image 813.

That is, the electronic device 101 may remove the motion informationacquired while the biometric signal is not acquired as a part by theinertial force.

As described above, the electronic device 101 may perform the inertialforce correction by using biometric information from the user.

FIG. 14 illustrate a flowchart illustrating a control method of theelectronic device according to embodiments of the present disclosure.

In operation 1410, the electronic device 101 may sense motioninformation of the electronic device 101.

In operation 1420, the electronic device 101 may determine a range ofthe sensed motion information. For example, the electronic device 101may preset the ranges shown in Table

TABLE 1 Electronic device state Acceleration range Inertial accelerationa to b Acceleration by user c to d

The inertial acceleration by the acceleration of the transportationmeans may be included in, for example, the range from a to b. Theacceleration by the user may be generated when the user turns the user'shead in order to change the virtual reality screen and may be includedin the range from c to d.

In operation 1430, the electronic device 101 may determine whether thesensed motion information of the electronic device is intended by theuser according to the range of the sensed motion information. Forexample, the electronic device 101 may identify that an absolute valueof the acceleration of the sensed motion is e. When e is included in therange from a to b, the electronic device 101 may determine that thesensed motion is the inertial force by the transportation means.Further, when e is included in the range from c to d, the electronicdevice 101 may determine that the sensed motion is intended by the user.

In operation 1440, the electronic device 101 may display the virtualreality screen by using a result of the determination.

As described above, the electronic device 101 may perform the inertialforce correction by removing the inertial force component whichcorresponds to motion information, outside the preset ranges.

FIG. 15 illustrates a flowchart illustrating a control method of theelectronic device according to embodiments of the present disclosure.The embodiment of FIG. 15 will be described in more detail withreference to FIGS. 16A to 16C. FIGS. 16A to 16C illustrate conceptualdiagrams illustrating a change in an orientation of the electronicdevice 101 according to embodiments of the present disclosure.

In operation 1510, the electronic device 101 may sense motioninformation of the electronic device. The electronic device 101 mayinclude sensors such as a linear acceleration sensor, a gyro sensor,and/or a geomagnetic sensor, which may sense various linearaccelerations, rotation angle accelerations, and/or orientationinformation of the electronic device. The electronic device 101 mayacquire motion information of the electronic device 101 based on outputvalues from the various sensors. For example, the electronic device 101may acquire a linear acceleration of the electronic device 101 based onthe output value from the linear acceleration sensor. The electronicdevice 101 may acquire a rotation angle acceleration of the electronicdevice 101 based on the output value from the gyro sensor. Theelectronic device 101 may acquire a motion in orientation information onthe electronic device 101 based on the output value from each of thegyro sensor and the geomagnetic sensor. The orientation information mayinclude a tilt information with respect to at least one axis that passesthrough a reference point of the electronic device 101.

In operation 1520, the electronic device 101 may determine whether theorientation of the electronic device 101 is changed. The electronicdevice 101 may determine whether the orientation of the electronicdevice 101 is changed by determining whether there is a time sequentialchange in the tilt information with respect to at least one axis thatpasses through the reference point of the electronic device 101.

When it is determined that the orientation of the electronic device 101is changed, the electronic device 101 may determine that the sensedmotion information of the electronic device is intended by the user inoperation 1530. For example, when the user turns the user's head whilewearing the electronic device 101 as illustrated in FIGS. 16A and 16B, atilt degree of the electronic device 101 may be changed by θ. FIG. 16Billustrates a plan view illustrating the electronic device 101 as viewedfrom above, and it may be noted that a tilt degree of the electronicdevice 101 is changed by θ in FIG. 16B. That is, the orientation of theelectronic device 101 may be changed by a user's motion.

When it is determined that the orientation of the electronic device 101is not changed, the electronic device 101 may determine that the sensedmotion information of the electronic device 101 is by the inertial forcein operation 1540. For example, when an inertial force 1610 is appliedin a state where the user wears the electronic device 101 as illustratedin FIG. 16C, the orientation of the electronic device 101 is notchanged. Accordingly, the electronic device 101 may determine that thesensed motion information without the change in the orientationinformation is by the inertial force 1610.

In operation 1550, the electronic device 101 may display the virtualreality screen by using a result of the determination. For example, whenit is determined that the orientation of the electronic device 101 ischanged, the electronic device 101 may determine that the sensed motioninformation of the electronic device is intended by the user, and changeand display the virtual reality screen in accordance with the motioninformation. When it is determined that the orientation of theelectronic device 101 is not changed, the electronic device 101 maydetermine that the sensed motion information of the electronic device101 is by the inertial force and maintain the virtual reality screenwithout any change.

As described above, the electronic device 101 may perform an inertialforce correction for removing the inertial force component whichcorresponds to the motion information acquired while the orientationinformation is not changed.

FIG. 17 illustrates a flowchart illustrating a control method of theelectronic device according to embodiments of the present disclosure.

In operation 1710, the electronic device 101 may sense motioninformation of the electronic device. The electronic device 101 mayinclude sensors such as a linear acceleration sensor, a gyro sensor,and/or a geomagnetic sensor, which may sense various linearaccelerations, rotation angle accelerations, and/or orientationinformation of the electronic device. The electronic device 101 mayacquire motion information of the electronic device 101 based on outputvalues from the various sensors.

In operation 1720, the electronic device 101 may determine whether thesensed motion is a rotation. For example, the electronic device 101 maysense a linear acceleration and a rotation angle acceleration and maydetermine whether the acquired motion information is the rotation byusing the sensed data.

When it is determined that the sensed motion is the rotation, theelectronic device 101 may determine that the sensed motion informationof the electronic device is intended by the user in operation 1730. Asillustrated in FIG. 16A, the user wearing the electronic device 101 mayturn the user's head in order to view another virtual screen.

When it is determined that the sensed motion is not the rotation, theelectronic device 101 may determine that the sensed motion informationof the electronic device is by the inertial force in operation 1740. Forexample, when the electronic device 101 senses only the linearacceleration as illustrated in FIG. 16C, the electronic device 101 maydetermine that the sensed motion information is by the inertial force.

In operation 1750, the electronic device 101 may display the virtualreality screen by using a result of the determination. For example, whenit is determined that the sensed motion is the rotation, the electronicdevice 101 may determine that the sensed motion information of theelectronic device is intended by the user, and change and display thevirtual reality screen in accordance with the motion information. Whenit is determined that the sensed motion of the electronic device 101 isnot the rotation, the electronic device 101 may determine that thesensed motion information of the electronic device 101 is by theinertial force and maintain the virtual reality screen without anychange.

As described above, the electronic device 101 may perform the inertialforce correction for removing the inertial force component whichcorresponds to a linear component of the motion information.Particularly, when the user boards an airplane which mainly performslinear acceleration, the accuracy of the inertial force correction maybe further improved.

FIG. 18 illustrates a flowchart illustrating a control method of theelectronic device according to embodiments of the present disclosure.The embodiment of FIG. 18 will be described in more detail withreference to FIGS. 19A and 19B. FIGS. 19A and 19B illustrate conceptualdiagrams illustrating an inertial force correction of the electronicdevice according to embodiments of the present disclosure.

In operation 1810, the electronic device 101 may sense motioninformation of the electronic device 101. The electronic device 101 mayinclude sensors such as a linear acceleration sensor, a gyro sensor,and/or a geomagnetic sensor, which may sense various linearaccelerations, rotation angle accelerations, and/or orientationinformation of the electronic device. The electronic device 101 mayacquire motion information of the electronic device 101 based on outputvalues from the various sensors.

In operation 1820, the electronic device 101 may acquire an image byphotographing an external environment of the electronic device 101. Theelectronic device 101 may acquire a plurality of image frames over time.The electronic device 101 may include a camera module that captures theplurality of image frames of an external environment. Alternatively, theelectronic device 101 may not include the camera module and, in thiscase, may receive a plurality of image frames from another electronicdevice including the camera module.

In operation 1830, the electronic device 101 may determine whetherimages photographed while the electronic device 101 moves are changed.The electronic device 101 may determine whether images are changed bycomparing adjacent image frames in the plurality of image frames. Theelectronic device 101 may determine whether the images are changed basedon a marker scheme or a markerless scheme.

When it is determined that the images are changed, the electronic device101 may determine that the sensed motion information of the electronicdevice 101 is intended by the user in operation 1840.

When it is determined that the images are not changed, the electronicdevice 101 may determine that the sensed motion information of theelectronic device is by the inertial force in operation 1850.

In operation 1860, the electronic device 101 may display the virtualreality screen by using a result of the determination. When it isdetermined that the images are changed, the electronic device 101 maydetermine that the sensed motion information of the electronic device101 is intended by the user, and change and display the virtual realityscreen in accordance with the motion information. When it is determinedthat the images are not changed, the electronic device 101 may determinethat the sensed motion information of the electronic device is by theinertial force and maintain the displaying of the virtual realityscreen.

For example, in FIG. 19A, the electronic device 101 may determine thatthe images are changed through the marker scheme. The electronic device101 may acquire an image for a first external environment 1910 includinga marker 1911 through the camera module. In this case, the inertialforce 612 may be applied to the electronic device 101 but the electronicdevice 101 does not detect the image change. Since the electronic device101 has not detected the image change, the electronic device 101 maymaintain a left eye image and a right eye image corresponding to thefirst screen 811.

On the contrary to this, the electronic device 101 may acquire an imagefor a second external environment 1920 including a marker 1921 in FIG.19B. The user may acquire the second external environment 1920 differentfrom the first external environment 1910 by rotating the head asindicated by reference numeral 810. The electronic device 101 determinethe image change according to the change in a location of the marker1921 of the image for the second external environment 1920 and alocation of the marker 1911 of the image for the first externalenvironment 1910. The electronic device 101 may change the first screen811 to the third screen 813 in accordance with the motion acquired whilethe images are changed and display the third image 813.

As described above, the electronic device 101 may perform the inertialforce correction for removing inertial force component which correspondsto the motion information acquired while the adjacent images of theplurality of images are not changed.

FIG. 20 illustrates a flowchart illustrating a control method of theelectronic device according to embodiments of the present disclosure.The embodiment of FIG. 20 will be described in more detail withreference to FIGS. 21A and 21B. FIGS. 21A and 21B illustrate conceptualdiagrams illustrating an electronic device according to embodiments ofthe present disclosure.

In operation 2010, the electronic device 101 may acquire an image byphotographing an external environment of the electronic device 101. Theelectronic device 101 may acquire a plurality of image frames accordingto the time. The electronic device 101 may include a camera module thatcapture the plurality of image frames of an external environment.Alternatively, the electronic device 101 may not include the cameramodule and, in this case, may receive a plurality of image frames fromanother electronic device including the camera module.

In operation 2020, the electronic device 101 may determine whetherimages photographed while the electronic device 101 moves are changed.The electronic device 101 may determine whether images are changed bycomparing adjacent image frames in the plurality of image frames. Theelectronic device 101 may determine whether the images are changed basedon a marker scheme or a markerless scheme.

In operation 2030, the electronic device 101 may determine motioninformation of the electronic device by using the changed images. Inoperation 2040, the electronic device 101 may display a virtual realityscreen by using the determined motion information. For example, in FIG.21A, the electronic device 101 may determine that the images are changedthrough the marker scheme. The electronic device 101 may acquire animage for a first external environment 1910 including a marker 1911through the camera module. Further, the electronic device 101 mayacquire the image for the second external environment 1920 including amarker 1921 in FIG. 21B. The user may acquire the second externalenvironment 1920 different from the first external environment 1910 byrotating the head as indicated by reference numeral 810. The electronicdevice 101 may acquire motion information 1930 according to the changein a location of the marker 1921 of the image for the second externalenvironment 1920 and a location of the marker 1911 for the firstexternal environment 1910. According to embodiments of the presentdisclosure, the electronic device 101 may acquire three dimensionalinformation by using a depth camera or a time of flight (TOF) cameraand, accordingly, acquire three dimensional motion information. Theelectronic device 101 may change the first screen 811 to the thirdscreen 813 in accordance with the motion acquired while the images arechanged and display the third image 813.

As described above, the electronic device 101 may set a reference point.When using optical information, the electronic device 101 may set thereference point and ignore an acceleration and a vibration valuemeasured when the reference point is not changed. The electronic device101 may perform initial rendering. The electronic device 101 may firstidentify whether a location of the reference point is changed when thereis a motion, and maintain the existing image when there is no motion.Otherwise, the electronic device 101 may perform rendering by using headtracking information when the motion is smaller than a preset threshold.When the motion is larger than the threshold, the electronic device 101may provide the same force in an opposite direction to offset the forceand display information which the user desires on the screen.

FIG. 22 illustrates flowchart illustrating a control method of theelectronic device according to embodiments of the present disclosure.The embodiment of FIG. 22 will be described in more detail withreference to FIG. 23. FIG. 23 illustrates a conceptual diagramillustrating the electronic device according to embodiments of thepresent disclosure.

In operation 2210, an external electronic device 2200 may transmitlocation information of the external electronic device 2200 to theelectronic device 101.

In operation 2220, the electronic device 101 may determine a relativelocation of the electronic device 101 with respect to the externalelectronic device 2200. The electronic device 101 may determine thereceived location of the electronic device 101 with respect to theexternal electronic device 2200 and, accordingly, determine the relativelocation.

In operation 2230, the electronic device 101 may determine motioninformation of the electronic device 101 according to a change in thedetermined relative location. For example, as illustrated in FIG. 23,the electronic device 101 may determine a first relative location 2330of the electronic device 101 with respect to a reference 2310. Thereference 2310 may be the location of the external electronic device2200. The electronic device 101 may determine the first relativelocation 2330 based on, for example, displacement between one point 2320of the electronic device 101 and the reference 2310. The electronicdevice 101 may determine a second relative location 2350 of theelectronic device 101 with respect to the reference 2310. The electronicdevice 101 may determine the second relative location 2350 based on, forexample, displacement between one point 2340 of the electronic device101 and the reference 2310. The electronic device 101 may determinemotion information according to a difference θ between the firstrelative location 2330 and the second relative location 2350.

In operation 2240, the electronic device 101 may display a virtualreality screen by using the determined motion information.

According to embodiments of the present disclosure, a method ofcontrolling an electronic device may include: an operation of acquiringmotion information of an electronic device; an operation of performingan inertial force correction for removing an inertial force componentfrom the acquired motion information; and an operation of displaying ascreen corresponding to the inertial force-corrected motion information.

According to embodiments of the present disclosure, the method ofcontrolling the electronic device may further include an operation ofacquiring the inertial force component.

According to embodiments of the present disclosure, the operation ofacquiring the inertial force component may include an operation ofreceiving the inertial force from another electronic device which isphysically separated from the electronic device and sensing the inertialforce.

According to embodiments of the present disclosure, the operation ofperforming the inertial force correction may include: an operation ofgenerating a corrected vector by adding an inverse vector of an inertialacceleration corresponding to the inertial force and an accelerationcorresponding to the motion information and the operation of displayingthe screen corresponding to the inertial force-corrected motioninformation may include an operation of displaying a screencorresponding to the generated corrected vector.

According to various embodiments of the present disclosure, theoperation of performing of the inertial force correction may include: anoperation of acquiring a biometric signal from at least one user's bodypart which generates the biometric signal when the user moves theelectronic device; and an operation of removing the inertial forcecomponent which corresponds to motion information acquired while thebiometric signal is not acquired.

According to various embodiments of the present disclosure, theoperation of performing the inertial force correction may include: anoperation of determining whether the motion information is included in apreset range; and an operation of removing the inertial force componentwhich corresponds to motion information outside the preset range.

According to embodiments of the present disclosure, the operation ofperforming the inertial force correction may include: an operation ofacquiring orientation information of the electronic device; and anoperation of removing the inertial force component which corresponds tomotion information acquired while orientation information is not changede.

According to various embodiments of the present disclosure, theoperation of performing the inertial force correction may include anoperation of removing the inertial force component which corresponds toa linear component of the motion information.

According to various embodiments of the present disclosure, theoperation of displaying the screen corresponding to the inertialforce-corrected motion information may include an operation ofdisplaying the screen in accordance with a rotation component of themotion information.

According to various embodiments of the present disclosure, the methodof controlling the electronic device may further include an operation ofacquiring a plurality of images generated by photographing an externalenvironment of the electronic device, and the operation of performingthe inertial force correction may include an operation of removing theinertial force component which corresponds to motion informationacquired while adjacent images of the plurality of images are notchanged.

Each of the components of the electronic device according to the presentdisclosure may be implemented by one or more components and the name ofthe corresponding component may vary depending on a type of theelectronic device. In various embodiments, the electronic device mayinclude at least one of the above-described elements. Some of theabove-described elements may be omitted from the electronic device, orthe electronic device may further include additional elements. Further,some of the components of the electronic device according to the variousembodiments of the present disclosure may be combined to form a singleentity, and thus, may equivalently execute functions of thecorresponding elements prior to the combination.

The term “module” used in the present disclosure may refer to, forexample, a unit including one or more combinations of hardware,software, and firmware. The “module” may be interchangeable with a term,such as a unit, a logic, a logical block, a component, or a circuit. The“module” may be the smallest unit of an integrated component or a partthereof. The “module” may be a minimum unit for performing one or morefunctions or a part thereof. The “module” may be mechanically orelectronically implemented. For example, the “module” according to thepresent disclosure may include at least one of an application-specificintegrated circuit (ASIC) chip, a field-programmable gate arrays (FPGA),and a programmable-logic device for performing operations which has beenknown or are to be developed hereinafter.

According to embodiments, at least some of the devices (for example,modules or functions thereof) or the method (for example, operations)according to the present disclosure may be implemented by a commandstored in a computer-readable storage medium in a program module form.When the command is executed by one or more processors (for example, theprocessor 120), the one or more processors may execute a functioncorresponding to the command. The computer-readable storage medium maybe, for example, the memory 130.

The computer readable recoding medium may include a hard disk, a floppydisk, magnetic media (e.g., a magnetic tape), optical media (e.g., acompact disc read only memory (CD-ROM) and a digital versatile disc(DVD)), magneto-optical media (e.g., a floptical disk), a hardwaredevice (e.g., a read only memory (ROM), a random access memory (RAM), aflash memory), and the like. In addition, the program instructions mayinclude high class language codes, which can be executed in a computerby using an interpreter, as well as machine codes made by a compiler.The aforementioned hardware device may be configured to operate as oneor more software modules in order to perform the operation of thepresent disclosure, and vice versa.

The programming module according to the present disclosure may includeone or more of the aforementioned components or may further includeother additional components, or some of the aforementioned componentsmay be omitted. Operations executed by a module, a programming module,or other component elements according to embodiments of the presentdisclosure may be executed sequentially, in parallel, repeatedly, or ina heuristic manner. Further, some operations may be executed accordingto another order or may be omitted, or other operations may be added.

According to embodiments of the present disclosure, a storage mediumhaving instructions stored therein is provided. The instructions areconfigured to instruct one or more processors to perform one or moreoperations when the instructions are executed. The one or moreoperations may include: an operation of acquiring motion information ofan electronic device; an operation of performing an inertial forcecorrection for removing a part by an inertial force from the acquiredmotion information; and an operation of displaying a screencorresponding to the inertial force-corrected motion information.

Although the present disclosure has been described with an exemplaryembodiment, various changes and modifications may be suggested to oneskilled in the art. It is intended that the present disclosure encompasssuch changes and modifications as fall within the scope of the appendedclaims.

What is claimed is:
 1. A method of controlling an electronic device, themethod comprising: acquiring motion information of the electronic deviceand a plurality of images generated by photographing an externalenvironment of the electronic device; acquiring information on inertialacceleration by processing the plurality of images; performing aninertial force correction for removing an inertial force component fromthe acquired motion information by using an inverse vector of theinertial acceleration corresponding to an inertial force; and displayinga screen corresponding to the inertial force-corrected motioninformation, wherein the inertial force correction comprises removingthe inertial force component that corresponds to motion informationacquired while adjacent images of the plurality of images are notchanged, wherein the performing of the inertial force correctioncomprises: acquiring a biometric signal from a body part of at least oneuser when the user moves the electronic device, and removing theinertial force component that corresponds to motion information acquiredwhen the biometric signal is not acquired.
 2. The method of claim 1,wherein the acquiring of the inertial force comprises receiving theinertial force from another electronic device which is physicallyseparated from the electronic device and senses the inertial force. 3.The method of claim 1, wherein the performing the inertial forcecorrection comprises generating a corrected vector by adding the inversevector of the inertial acceleration corresponding to the inertial forceand an acceleration corresponding to the motion information, and thedisplaying of the screen corresponding to the inertial force-correctedmotion information comprises displaying a screen corresponding to thegenerated corrected vector.
 4. The method of claim 1, wherein theperforming of the inertial force correction comprises: determiningwhether the motion information is included in a preset range; andremoving the inertial force component which corresponds to motioninformation outside of the preset range.
 5. The method of claim 1,wherein the performing of the inertial force correction comprises:acquiring orientation information of the electronic device; and removingthe inertial force component which corresponds to motion informationacquired while orientation information is not changed.
 6. The method ofclaim 1, wherein the performing of the inertial force correctioncomprises removing the inertial force component which corresponds to alinear component of the motion information.
 7. The method of claim 6,wherein the displaying of the screen corresponding to the inertialforce-corrected motion information comprises displaying the screen inaccordance with a rotation component of the motion information.
 8. Anelectronic device comprising: a display; a camera; a processorelectrically connected to the display; and a motion information sensingmodule that is electrically connected to the processor and configured toacquire motion information of the electronic device, wherein theprocessor is configured to: acquire, through the camera, a plurality ofimages generated by photographing an external environment of theelectronic device; acquire information on inertial acceleration byprocessing the plurality of images; and perform an inertial forcecorrection for removing an inertial force component from the acquiredmotion information by using an inverse vector of an inertialacceleration corresponding to an inertial force and to control thedisplay to display a screen corresponding to the inertialforce-corrected motion information, wherein the processor is configuredto remove the inertial force component that corresponds to motioninformation acquired while adjacent images of the plurality of imagesare not changed, wherein the processor is configured to: acquire abiometric signal from a body part of at least one user when the usermoves the electronic device, and remove the inertial force componentthat corresponds to motion information acquired when the biometricsignal is not acquired.
 9. The electronic device of claim 8, furthercomprising a communication module configured to receive the inertialforce from another electronic device which is physically separated fromthe electronic device, wherein the another electronic device senses theinertial force.
 10. The electronic device of claim 8, wherein theprocessor is configured to generate a corrected vector by adding theinverse vector of the inertial acceleration corresponding to theinertial force and an acceleration corresponding to the motioninformation and to control the display to display a screen correspondingto the generated corrected vector.
 11. The electronic device of claim 8,wherein the processor is configured to determine whether the motioninformation is included in a preset range and to remove the inertialforce component which corresponds to motion information outside thepreset range.
 12. The electronic device of claim 8, wherein theprocessor is configured to acquire orientation information of theelectronic device and to remove the inertial force component whichcorresponds to motion information acquired while orientation informationis not changed.
 13. The electronic device of claim 8, wherein theprocessor is configured to remove the inertial force component whichcorresponds to a linear component of the motion information.
 14. Theelectronic device of claim 13, wherein the processor is configured tocontrol the display to display the screen in accordance with a rotationcomponent of the motion information.